Update Sirius results (March 2026)#812
Conversation
sirius/benchmark.sh
Outdated
| rm -rf sirius | ||
|
|
||
| # Build Sirius from your optimized fork | ||
| git clone --recurse-submodules -b clickbench https://github.com/sirius-db/sirius.git |
There was a problem hiding this comment.
Does "optimized fork" mean a Sirius version that was tailored for ClickBench? If yes ... it would be nicer to test default Sirius instead.
There was a problem hiding this comment.
Hi Robert,
The Sirius version used here is not tailored for ClickBench. The branch includes a few general optimizations that are also part of the default branch. To reduce confusion, we have updated the PR to use the latest dev branch and updated the numbers and scripts accordingly.
…Add H100 result too
|
AWS returns an "insufficient capacity" errors in all the regions I tested when I try to setup a |
Same problem still. Merging this PR without validating it (SiriusDB folks asked to get it it by Monday, if possible). |
Update Sirius benchmark results and scripts:
Update the scripts to use pixi following the latest build instructions on Sirius repo
Update the results using the latest Sirius on both GH200 (Lambda) and p5.4xlarge (AWS)